Masks protect you from the virus. These clothes which actually sieve the viruses might be carrying a huge amount of it on its outside.
It is always advisable to safely unmask yourself without letting the outer portion of the mask touch any part of your body and disposing of it immediately or else keeping it away for washing it.